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^ 1 Introduction 

In the last few years, the research communities that study human behavior have gained access to 

O unprecedented computational and sensing power that basically "fits into a pocket". This has happened 

<^ for both specialized equipment used for building research tools, such as Reality Mining Badges [1] 

or accelerometer sensors [2], as well as for consumer-grade, off-the-shelf devices. Smartphones and 

tablets are capable of sensing, processing, transmitting, and presenting information. This has already 

I— I had a significant impact on many research domains, for example social science [3], computer human 

\^ interaction [4], or mobile sensing [5,6]. In neuroscience there is a widely recognized need for mobility, 

P^ i.e., for devices that support quantitative measurements in natural settings [7-9]. Here we present 

(/5 our work on the Smartphone Brain Scanner investigating the feasibility of off-the-shelf, consumer grade 

^ O^ equipment in a neuroscience context, building a mobile real-time platform for stimulus delivery, data 

acquisition, and processing with a focus on real-time imaging of brain activity. 

^-H Consumer grade neuroheadsets, capable of recording brain activity generated by post-synaptic 

^ potentials of firing neurons, captured through electrodes placed on the scalp using Electroencepahlog- 

raphy (EEC), have only recently made mobile brain monitoring feasible. Seen from a mental state 

^T) decoding perspective, even a single channel EEC recording measuring the changes in electrical poten- 

^^ tials, based on a passive dry electrode positioned at the forehead and a reference typically placed on 

"^ the earlobe, allows for measuring mental concentration and drowsiness, by assessing the relative dis- 

^^ tribution of frequencies in brain wave patterns throughout the day. Or, simply measuring the dynamic 

^^ variability of brain wave frequency components in a mobile scenario, may be translated into neural sig- 

• . natures, e.g. reflecting whether a user is on the phone while driving a car [10]. Similarly, positioning 

^ ^ the single EEC electrode headband over the temple, may provide the foundation for building a Brain 

^^ Machine Interface (BCI) utilizing the ability to capture steady state visual evoked potentials (SSVEP) 

?-H from the visual cortex when looking at flashing lights patterns, and thereby design a BCI interface for 

prediction with high accuracy and no previous training when a disabled user is focusing on a specific 

area of a screen, based on the time locked EEC traces automatically generated as multiples of the 

particular flashing light frequencies [11]. 

As an example of the underlying technology used in several consumer products, the ThinkGear 
module manufactured by NeuroSky ^ integrates a single dry electrode, reference and ground, attached 
to a headband. Essentially a system on a chip, it providies A/D conversion and amplification of one 
EEC channel, capable of capturing brain wave patterns in the 3-100 Hz frequency range, recorded at 
512Hz sampling rate. Consumer neuroheadsets such as those manufactured by Emotiv ^ provide low 
density neuroimaging based on 16 electrodes and typically support real-time signal processing in order 
to complement standard EEC measures with aggregate signals, that provide additional information on 
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changes in mental state, or facilitate control of peripheral devices related to games. Their portability 
and built-in wireless transmission make them suitable for development of fully mobile systems that 
allow for running EEG experiments in natural settings. The improved comfort of these mobile solutions 
also allows for extending neuroimaging experiments over several hours. Furthermore, the relatively 
low cost of the neuroheadsets and mobile devices potentially open new opportunities for conducting 
novel types of social neuroscience experiments, where multiple subjects are monitored while they 
interact [12,13]. 

However such Tow-fi' mobile systems present a number of challenges. In real-time applications, 
requiring signal processing to be performed with the lowest possible delay in order to present feedback 
to the user, the limited computational power of mobile devices may be a constraint. A solution might 
be to offload parts of the processing to an external server and retrieve the processed results over the 
network. Consumer-grade mobile devices also present technical challenges for writing high-quality 
software: the devices operate on non-real-time operating systems ill-suited for time-sensitive tasks. 
These limitations might also affect timing of visual or auditory stimuli presentation, as well as syn- 
chronization with other sensors. From a neuroscience perspective, both the low-resolution recordings 
and artifacts induced in a mobile setup present significant challenges. Noise and confounds are in- 
troduced by movement of the subject and electrical discharges, while the positioning of the electrodes 
might be less than ideal when compared to a standard EEG setup [14, 15]. Nevertheless, we hold 
that these drawbacks are clearly offset by the advantages of being able to conduct studies incorpo- 
rating larger groups of subjects over extended periods of time in more natural settings. We suggest 
that mobile EEG systems can be considered from two viewpoints: As stand-alone portable low-fi neu- 
roimaging solutions, or alternatively as an add-on for retrieving neuroimaging data under natural 
conditions complementary to standard neuroimaging lab environments. 

In terms of software programming, creating a framework for applications in C++ rather than 
prevalent environments such as MATLAB, while approaching the problem as a smartphone sens- 
ing challenge, might enable new types of contributions to neuroscience. The Human Computer In- 
teraction (HCI) community is already starting to apply consumer-grade headsets to extend existing 
paradigms [16], thus incorporating neuroscience as a means to enhance data processing. Similarly 
the availability of low cost equipment means that even general 'hacker and tinkerers' audiences gain 
interest in using neuroscience tools ^. We see a great value in the emerging potential of entirely new 
groups of researchers and developers getting interested in neuroscience and obtaining tools allowing 
them to develop new kinds of applications. 

2 Related Work 

Our real-time imaging EEG setup mediates between to hitherto disparate fields in sensorics, being on 
one hand a down-sized neuroimaging device and on the other hand a sophisticated smartphone sensor 
system for cognitive monitoring in natural conditions. We therefore briefly review the state of the art 
in both domains. 

2.1 Neuroimaging 

Several software packages for off-line and on-line analysis of biomedical and EEG signals are available. 
The most popular packages for off-line analysis are EEGLAB and FieldTrip; for building real-time 
BCI-oriented applications, notable frameworks are BCILAB, OpenViBE, and BCI2000. 
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EEGLAB is a toolbox for the MATLAB environment for processing collections of single-trial or 
averaged EEG data [17]. Functions available in this framework include data importing, preprocessing 
(artifact rejection, filtering), independent component analysis (ICA), and other. The framework can be 
used via a graphical interface or by directly manipulating MATLAB functions. The toolbox is available 
as open source (GNU license) and can be extended to incorporate various EEG data formats coming 
from different hardware. Similarly, FieldTrip is an open source (GNU License) MATLAB toolbox for 
the analysis of MEG, EEG, and other electrophysiological data [18]. Among others, FieldTrip has 
pioneered high-quality source reconstruction methods for EEG imaging. Fieldtrip has support for 
real-time processing of data based on a buffer construction that allows chunking of data for further 
processing in the MATLAB environment. 

BCILAB is a toolbox for building online brain-computer interface (BCI) models from available 
data [19]. It is a plugin for EEGLAB running in MATLAB, providing functionalities for designing, 
learning, use, and evaluation of real-time predictive models. BCILAB is focused on operating in real- 
time for detecting and classifying cognitive state. The classifier output from BCILAB can be streamed 
to a real-time application to effect stimulus or prosthetic control, or may be derived post-hoc from 
recorded data. The framework is extensible in various layers: additional EEG hardware as well as data 
processing steps (e.g. filters and classifiers) can be added. But as these tool-boxes are developed within 
the MATLAB environment, neither FieldTrip's real-time buffer nor BCILAB are suitable for mobile 
application development. 

OpenViBE is a software framework for designing, testing, and using Brain Computer Interfaces [20]. 
The main application fields of OpenViBE are medical i.e. assistive technologies, bio- and neurofeedback 
as well as virtual reality multimedia applications . OpenViBE is open source (LGPL 2.1) and targets 
an audience focused on building real-time applications for Windows and Linux Operating Systems, 
and does not specifically support light-weight mobile platforms. A similar C++ based framework for 
building real-time BCI applications is BCI2000 [21]. A comprehensive review of the BCI frameworks 
can be found in [22]. Some of the consumer EEG systems also include Software Development Kits 
(SDKs) allowing for data acquisition, processing, and building applications. Emotiv SDK, available 
with Research Edition of Emotiv system is multi-platform, currently running on Windows and OSX, 
with Linux support in beta. The SDK allows for building applications either using raw EEG data or 
extracted features including affective state and recognition of facial expressions based on eye move- 
ments. The extracted features can be integrated into a C++/C# application through a set of dynamically 
linked libraries. Although such SDK frameworks can greatly speed up the process of building BCI ap- 
plications, they are mostly targeted towards scenarios where immediate feedback is available such as 
gaming, and it remains a challenge to validate or tweak code for custom needs. To sum up, none of the 
aforementioned software platforms can easily be adapted to support mobile and embedded devices. 

2.2 Cognitive IVIonitoring Systems 

Mobile brain imaging might also be viewed as yet another sensor extension to self-tracking applica- 
tions, which have become prevalent with smartphones and the emergence of low-cost wearable devices 
lowering the barriers for people to engage in life logging activities [23]. With the availability of multiple 
embedded sensors modern smartphones have become a platform for out-of-the-box data acquisition of 
mobility (GPS, cellular network, WiFI), activity level (accelerometer), social interaction (Bluetooth, call, 
and text logs), and environmental context (microphone, camera, light sensor) [3]. Recently non-invasive 
recording of brain activity has become common as several low-cost commercial EEG neuro-headset and 
headband systems have been made available, including apart from the previously mentioned Emotiv 



EPOC and NeuroSky ^, the InteraXon Muse ^, Axio ^, and Zeo ^ . These sensors support applications 
ranging from BCI, game control, stress reduction, cognitive training, to sleep monitoring. These neuro- 
headsets feature up to 16 electrodes, but ongoing developments promise next-generation low-cost EEG 
devices with significantly higher number of electrodes, better quality signals, and improved comfort. 
The Smartphone Brain Scanner framework described in this paper, can be used with mobile EEG de- 
vices with various numbers of electrodes to allow for capture of neuroimaging data over several hours. 
Battery tests on Samsung Galaxy Note with all wireless radios and screen turned off resulted in 11 
hours of uninterrupted recording and storage of data from an Emotiv EPOC headset. However in real- 
ity current generation neuroheadsets are limited by their solution-based electrodes which dry out, and 
more comfortable designs [24, 25] may be required for continuous mobile neuroimaging throughout 
the day. 

Beyond EEG multiple bio signals and physiological parameters can contribute to cognitive state 
monitoring, such as respiratory rate [26], heart rate variability, galvanic skin response [27], blood pres- 
sure, oxygen saturation, body/ skin temperature, ECG, EMG, and body movements [28]. A webcam 
or a camera embedded in a smartphone allow measurements of heart rate, variability, and respiratory 
rate by analyzing the color channels in the video signal [29]. Continuous monitoring of heart rate is 
enabled by pulse watches ^ and recently the Basis Band wrist-worn sensor ^ that allow 24/7 recording 
under a subset of conditions (non-workout situations), allowing user mobility and measurements in 
natural conditions. The Q Sensor from Affectiva ^^ is an example of a system for monitoring galvanic 
skin response (GSR) and accelerometer and temperature data from a wrist- worn device. FitBit ^^ is 
an example of a wearable pedometer, monitoring number of steps taken, distance traveled, calories 
burned, and floors climbed. 

3 Methods: The Smartphone Brain Scanner 

The Smartphone Brain Scanner (SBS2) is a software platform for building research and end-user oriented 
multi-platform EEG applications. The focus of the framework is on mobile devices (smartphones, 
tablets) and on consumer-grade (low-density and low-cost) mobile neurosystems (see Fig. 2. The SBS2 
is freely available under the MIT License on GitHub at https : //github . com/SmartphoneBrainScanner. 
The SBS2 framework is divided into three layers: low-level data acquisition, data processing, and 
applications. The first two layers constitute the core of the system and include common elements used 
by various applications. An overview of the architecture is shown in Fig. 1. 

3.1 Key Features 

With focus on the mobile devices, SBS2 is a multi-platform framework. The underlying technology - 
Qt - is an extension of C++ and is currently supported on the main desktop operating systems (Linux, 
OSX, Windows) as well as mobile devices (Android, BBIO, and partially iOS)^^. 
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Figure 1. Overview of the layered architecture of the SBS2 framework. Data from the connected EEG 
hardware are acquired and extracted by specific adapters and all subsequent processing is hardware 
agnostic. The empty boxes indicate the extensibility of the architecture allowing additional hardware 
devices for data acquisition and additional processing methods. 




Figure 2. The system with Emotiv EPOC wireless EEG headset (1), Receiver mod- ule with USB 
connector (2), USB connector and adapter (3+4), and Nokia N900 (5). 



We have aimed for a modular framework, allowing for adding and modifying data acquisition 



and processing blocks. The modules are created as C++ classes and integrate directly with the core 
of the framework. The framework supports building real-time applications; data can be recorded for 
subsequent off-line analysis, however most of the implemented data processing blocks aim to provide 
real-time functionality for working with the EEC signal. The applications developed with SBS2 can be 
installed on desktop and mobile devices, started by the user in a usual way and distributed via regular 
channels, such as repositories and application stores. 

3.2 Data Acquisition 

The Data Acquisition layer is responsible for setting up communication with an EEG device, acquiring 
the raw data, and forming packets. Three primary objects are used: Sbs2Mounter, Sbs2DataReader, 
and Sbs2Packet, thereby abstracting all the specificities of the EEG systems (hardware) and OS + de- 
vice running the software (platform). Different embedded devices, even with the same OS may require 
specific code for certain low-level functionalities, for example to access the USB port. A higher-fidelity 
architecture is shown in Figure 3. The EEG hardware is set up by a specialized Sbs2Mounter object. The 
information about the hardware (e.g. mounting point, serial number) is passed to a Sbs2DataReader 
object. This object subsequently begins reading the raw data from the hardware. The raw data are 
passed to a Sbs2Packet object to create a proper encapsulation, setting the values for all the EEG chan- 
nels and metadata. Once formed, the packet is pushed to the Data Processing layer via a Sbs2Callback 
object. 

The Data Acquisition layer of the SBS2 is originally designed to support the Emotiv EPOC headset. 
It has been extended to support additional hardware, by implementing additional classes of the hard- 
ware mounter, data reader, and packet creator. For Emotiv headset, this layer also contains the data 
decryption module, as the stream coming from the device is encrypted. 

Mounting the EEG hardware on a desktop and embedded devices require drivers, either stan- 
dard kernel modules or proprietary drivers created by the vendor. The Emotiv EPOC USB receiver 
is mounted as /dev/hidraw in Linux (desktop and Android), provided that the device and kernel sup- 
port USB host mode and have the HIDRAW module enabled. Most desktop Linux flavors have both 
by default, but currently most Android mobile devices support only USB host mode out-of-the-box. 
In the current implementation a custom kernel needs to be compiled with the HIDRAW module en- 
abled. Reading the data directly from the /dev/hidraw device requires 'root' privileges, which must 
be enabled on Android devices to acquire data from the Emotiv EPOC receiver. This is possible for 
most recent Android devices, e.g. for the Nexus (developer) line of devices. We can expect that the 
next generation of mobile neuroheadsets will use standardized Bluetooth low-energy protocols and 
Android devices will be able to support them by default. This will likely have a significant impact on 
the adoption of neuroimaging outside lab environments. 

3.3 Data Processing 

Well-formed EEG packet objects are used for data processing. The functionality of this layer is hard- 
ware agnostic and depends only on packet content, i.e. data for the EEG channels, reflecting a particu- 
lar sensor configuration, and sampling frequency. Single packets are dispatched to different processing 
objects and methods, including recording, filtering, 3D reconstruction etc. Some operations need to 
collect data into frames and run asynchronously (in separate thread), pushing the results back to the 
callback object once the results are ready. 

Sbs2Callback is an object implementing the getData(Sbs2Packet*) method, to which single pack- 
ets are always passed and can then be dispatched to the Sbs2DataHandler or pushed to the Application 
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Figure 3. The Smartphone Brain Scanner architecture. Data are acquired in the first layer from the 
EEG hardware, passed to the Data Processing Layer and extracted features as well as raw values are 
then available for applications. 

layer. Sbs2DataHandler is an object providing methods for data processing, by delegating them to spe- 
cialized objects, including Sbs2FileHandler and Sbs2Filter. 

The framework for data processing is extensible and new modules can be added to the core, the 
data handler prepares the data in a format expected by the processing block (e.g. collecting packets 
into larger frames) and runs the processing method. The currently implemented blocks allow for a 
variety of processing operations. The raw EEG data can be recorded, including timestamped events 
(stimuli onsets, user responses etc.). Raw packets as well as extracted features and arbitrary values can 
be streamed over the network, either for data processing or for interconnection between devices, for 
example for multiplayer gaming. Other methods for data processing, including filter, EFT, spatial filter 
(CSP), and classifier (LDA) are also implemented and can be used for building the pipelines. 



3.4 3D Imaging 

The most advanced data processing block of the Smartphone Brain Scanner is the source reconstruction 
aimed at real-time 3D imaging. Source reconstruction estimates the current sources within the brain 
that are most likely to have generated the observed EEG signal at the scalp level. As the number of 
possible source locations far exceeds the number of channels, this is known to be an extremely ill-posed 
inverse problem. A unique solution is obtained by imposing prior information in correspondence with 
e.g. anatomical, physiological, or mathematical properties [30-32]. Implemented inverse methods in 



the SBS2 covers Bayesian formulations of the widely used Minimum-norm method (MN) [32] and low 
resolution electromagnetic tomography (LORETA) [33]. The Bayesian formulation used in the SBS2 
framework allows adaptation of hyper-parameters to different noise environments in real-time. This is 
an improvement over previous real-time source reconstruction approaches [34-36] that apply heuristics 
to estimate the parameters involved in the inverse method. The current source reconstruction is based 
on an assumed forward model matrix. A, connecting scalp sensor signals Y (channel by time) and 
current sources S (cortical locations by time) [37] 

Y = AS + 5. (1) 

The term £ accounts for noise not modeled by the linear generative model. When estimating the 
forward model a number of issues are taken into consideration such as sensor positions, the geometry 
of the head model (spherical or 'realistic' geometry), and tissue conductivity values [38-40]. With the 
forward model A given and the linear relation in Eq. (1) the source generators can be estimated. We 
assume the noise term to be normal distributed, uncorrected, and time independent leading to the 
probabilistic formulation 



p(Y|S) = X\M[yt As,,r'lN.) (2) 
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Where p (S) is the prior distribution over S with L given as a graph Laplacian ensuring spatial coher- 
ence between sources, and j6~^ as the noise variance. Using Bayes' rule the posterior distribution over 
the sources is maximized by 
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(5) 

Here, L denotes a spatial coherence matrix, which in the current form take advantage of graph Lapla- 
cian using a fixed smoothness parameter (0.2). 

4 Methods: Experimental Designs 

In this section we briefly describe the design of experiments that demonstrate and validate the potential 
of the SBS2 framework, the specific hardware, and the mobile approach in general. 

4.1 Timing and Data Quality 

First, we analyze the data and timing quality. Many neuroscience paradigms rely heavily on accurate 
synchronization between EEG signal and stimuli, user response, or data from other sensors (e.g. P300, 
steady state visual evoked potentials). However, we can also envision applications in which the present 
'low-cost' mobile setup will be used to collect data from many subjects over extended periods, where 
the precise synchronization is less important. 
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Figure 4. The timing measurement setup. lOHz sinusoid is generated with a sound card, amplified, 
and fed into an oscilloscope and the EEG hardware. 

4.1.1 Emotiv EEG sampling 

The measurements are all based on the Emotiv EEG neuroheadset. The nominal sampling frequency 
of this neuroheadset is 128Hz (downsampled from internal 2048Hz). For validation purposes we test 
the actual sampling rate obtained from 3 randomly picked Emotiv devices (10 x 10 min measurements 
for each). 

4.1.2 Data Quality 

The Emotiv hardware adds a modulo 129 counter (0 — 128) to every packet transmitted from the device. 
This allows for data quality control (dropped packets) with accuracy of modulo 129. It is possible to 
obtain long recordings (over one hour) using this neuroheadset and SBS2. The battery in the Emotiv 
hardware is rated at 12/z of continuous operation; in recording-only setup mobile device such as Galaxy 
Note (offline mode, screen off, only decrypting and recording) lasts for around 10/z. Provided that good 
visibility between the Emotiv EEG neuroheadset transmitter (located in the back part of the headset) 
and USB receiver is maintained, we were able to achieve zero packet loss in the full rundown recording. 
In order to acquire an EEG signal of good quality, the impedance between the electrodes and the scalp 
should be kept under 5kCl. The Emotiv headset embeds the channel quality information in the signal 
directly (2Hz per channel, multiplexed into the signal). The values are unsealed, and come from 
applying a square wave of llSHz to the DRL feedback circuit and extracting the amplitude of the 
inherent square wave using phase-locked detection on each channel. In principle the obtained values 
can be calibrated using a known impedance. For regular usage however, the hardware manufacturer 
assures that the green color of the indicator (channel quality value greater than 407) corresponds to 
sufficiently low impedance of the electrode. From our experience with the system this appears correct. 



4.1.3 Timing 

In order to measure the total delay in the system, we use the setup as depicted in Fig. 4. A sinusoidal 
audio tone of lOHz and trailing and following periods of silence is generated and amplified so it can 
be detected by the EEG hardware and split into oscilloscope and EEG hardware. The software on the 
device performs peak detection on the signal and visualizes the peaks by changing the screen color 
from black to white. This change is detected by a photocell, connected to the second channel of the 
oscilloscope. We can then calculate dtl = tl — tl, indicating the total delay of the system from the 
physical signal reaching the EEG hardware to it being visualized on the screen (without any additional 
processing), see Figure 6. We also look at the jitter dtl as the difference between min and max values 
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Figure 5. Measured sampling frequency, including measurement resolution for 3 random Emotiv 
EPOC devices, 10 x lOmin recordings for each. All measured rates, including uncertainty are between 
127.8828Hz and 127.8841Hz, corresponding to .99908 and .99909 of nominal 128Hz. The 
measurements were performed with 1ms resolution (2ms accuracy) on 76800 EEG packets. All tests 
were performed in a normal temperature on a single day. 

of dtl. The observed delta depends on the EEG sampling rate (here 128Hz), the processing power of 
the device, and screen refresh rate (60Hz for all tested devices). 

4.2 Imagined Finger Tapping 

One of the best known and examined experiments from the BCI literature is a task in which a subject is 
instructed to select between two or more different imagined movements [41-44]. Such experiments are 
rooted in a central aim of many BCI systems, namely of being able to assist patients with severe motor 
disabilities to communicate by 'thought'. In this contribution we replicate a classical experiment with 
imagined finger tapping (left vs. right) inspired by [44]. The setup consisted of a set of three different 
images with instructions. Relax, Left, and Right. In order to minimize the effect of eye movements, the 
subject was instructed to focus on the center of the screen, where the instructions also appeared (3.5 
inch display size, 800 x 480 pixels resolution, at a distance of 0.5 m). The instructions Left and Right 
appeared in random order. A total of 200 trials were conducted for a single subject. 



5 Results and Discussion 

In this section we present and discuss the results of the experiments, validating the performance of the 
software, the used platforms, and EEG hardware. 

5.1 Timing and Data Quality 

5.1.1 Emotiv EEG sampling 

From Fig. 5 we can see that the Emotiv EPOC hardware a) has an actual sampling rate close to 127.88Hz 
and b) keeps this sampling rate in a fairly consistent manner. Depending on the analysis performed 
on the data, one can assume 128Hz, 127.88Hz, or measure the actual sampling rate for every Emotiv 
EPOC hardware device individually. 
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Figure 6. System response timings. Galaxy Note running Android 4.0.1, 60Hz AMOLED screen, 
tl = 125ms, t2 = 16ms; Nexus 7 running Android 4.1.1, 60Hz IPS LCD screen, tl = 85ms, t2 = 26ms; 
MacbookPro, LCD screen (60Hz), tl = 80ms, f2 = 26ms. 

5.1.2 Timing 

The results of the timing measurements (20 per device) are depicted in Fig. 6. We can see in the results 
that for all devices there is a significant delay between the signal reaching the EEG hardware and being 
fully processed in the software (80 — 125ms). This delay however, although significant is fairly stable 
(16 — 26ms jitter) and thus can be corrected for. 

In the second set of measurements, we test the stability of the timing of the packets as they appear 
in the system. To measure this, we collect the packets from the Emotiv EPOC device and change the 
screen color every 4 packets (limited by screen refresh rate, 60Hz). This change is then measured by a 
photocell and fed into the oscilloscope and the distance between the 4-packet packages is calculated. 
Fig. 7 shows these measurements. In summary, the stability and quality of the acquired signal is 
excellent. Most of the variations, including imperfect sampling rate or timing jitters are constant and 
can be largely accounted for in the data analysis if necessary. 



5.1.3 3D Source Reconstruction On-Device Performance 

Source imaging was obtained using the Bayesian inverse solver for the linear model in Eq. (1). The 
forward matrix A and cortical source mesh grid was based on a coarse resolution (5124 vertices) of the 
SPM8 template brain [45], further reduced to 1028 using Matlab's function reducepatch. We tested the 
performance of 3D reconstruction and hyper-parameters calculation on Is of signal: MacBookPro8,2 
(Intel Core 17 Sandy Bridge 2.2GHz): 2ms /2s, Nexus 7: 8ms /Is, Galaxy Note: 8ms /I Is, and Acer 
Iconia: 14ms /13s. 
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Figure 7. Distances between 4-sainple frames. Red line indicates expected distance of 

4/127.88 = 0.03106ms. The bars indicate the observed distance. We can see that the Emotiv system 

compensates every 8 x 4 = 32 samples to keep the average (black line) at the correct level. 

5.2 Imagined Finger Tapping - Online Source Reconstruction 

In order to demonstrate the applicability of discriminating a simple task as the left and right imagined 
finger tapping on the cortical source level in an online framework, the EEG data were acquired with 
the Emotiv EPOC neuroheadset and compared with EEG recordings acquired with a Biosemi Active-II 
device 64 channels. The 64-channels were subsampled to represent the same channel locations as the 
Emotiv device. 

Imagined fingertapping is known to lead to a suppression of the alpha (8-13 Hz) activity over the 
premotor/ motor regions, with the contra lateral areas normally being more desynchronized [46]. Thus, 
imagined right finger tapping, should lead to the alpha activity being suppressed both in the left and 
right pre-motor region with the Left as the dominant one. This is confirmed in Fig. 8a and Fig. 8b, 
which demonstrate the SBS2 framework ability to online reconstruct meaningful current sources within 
the brain. Fig. 8a shows how alpha power (8-13 Hz) is suppressed over time in the two regions of 
interest; Precentral Left and Right AAL. The responses are calculated as the averaged response over 87 
Right cued trials. Note, that even though this result is an average over runs, the source localization was 
carried out in online mode with model parameters (oc and j6) and current sources (S) estimated online. 
By collecting these source estimates over time we have just presented the averaged response at the end 
of the experiment. Similarly, Fig. 8b demonstrates the averaged power response across 79 Right cued 
trials. Interestingly, the suppression of the alpha power in the Left and Right Precentral AAL regions to 
right imagined finger tapping trials, looks quite similar for both devices (Emotiv EPOC and Biosemi), 
with the contralateral frontal regions (Left) being mostly suppressed. 



6 Conclusions 

We have presented the design, implementation, and evaluation of the first fully mobile 3D EEG imaging 
system: The Smartphone Brain Scanner. The open source software allows realtime EEG data acquisition 
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Figure 8. Mean (solid lines) and standard deviation (dashed lines) of reconstructed current source 
power in the left (L) and right (R) Precentral AAL regions calculated across Right cued imagined 
finger tapping conditions. Online estimation of the oc and j6 parameters. Minimum Norm Solution. 
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and source imaging on standard off-the-shelf Android mobile smartphones and tablets with a good 
spatial resolution and frame rates in excess of 40 fps. In particular, we have implemented a real-time 
solver for the ill-posed inverse problem with online Bayesian optimization of hyper-parameters (noise 
level and regularization). 

The evaluation showed that the combined system provides for a stable imaging pipeline with a 
delay of 80-120ms. We showed results of a cue imagined finger tapping experiment and compared 
the smartphone brain scanner's average power in the alpha band in a relevant motor area, and we 
found that these aggregate signals compare favorably with those obtained with standard laboratory 
equipment. Both show the expected de-synchronization on initiation of imagined motor actions. 

We suggest that the mobility and simplified application development may enable completely new 
research directions for imaging neuroscience and thus offset the expected reduced signal quality of 
a mobile off-the-shelf, low-density neuroheadset relative to more conventional and controlled, high- 
density laboratory equipment. 
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